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SUMMARY 


An  experiment  is  repoiied  evaluating  the  effectiveness  of  a  mnemonic 
procedure,  called  the  keyword  method,  for  learning  a  foreign  language 
vocabulary.  The  method  divides  the  study  of  a  vocabulary  item  into  two 
stages.  The  first  stage  requires  S  to  associate  the  spoken  foreign  word 
to  an  English  word  (the  keyword)  that  sounds  like  some  part  of  the 
foreign  word;  the  second  stage  requires  S  to  form  a  mental  image  or 
picture  of  the  keyword  "interacting"  witn  the  English  translation.  Thus, 
the  keyword  method  cor.  be  described  at  a  chain  of  two  links  connecting 
n  foreign  word  to  its  English  translation  through  the  mediation  of  a 
keyword:  the  foreign  word  is  linked  to  a  keyword  by  a  similarity  in 
sound  (acoustic  link),  and  the  keyword  is  linked  to  the  English  trans¬ 
lation  by  a  mental  image  (imagery  link).  The  experiment  reported  here 
compared  the  keyword  method  with  an  unconstrained  control  procedure 
using  Russian  vocabulary.  On  all  measures  the  keyword  method  proved  to 
be  highly  effective,  yielding  for  the  most  critical  test  a  score  of  72# 
correct  for  the  keyword  group  compared  to  46#  for  the  control  group. 
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*N  APPLICATION  OF  THE  MNEMONIC  KEYWORD  METHOD  TO 
THE  ACQUISITION  OF  A  RUSSIAN  VOCABULARY1 
Richard  C.  Atkinson  and  Michael  R.  Raugh 
Stanford  University 

Mental  imagery  has  long  been  used  as  a  means  of  memorizing  Informa¬ 
tion  j  Roman  orators  employed  the  technique  when  memorizing  long  speeches 
(Yates,  1972},  and  entertainers  use  mental  imagery  to  perform  impressive 
feats  of  memory.  In  recent  years,  mental  imagery  has  been  investigated 
in  the  psychological  laboratory  both  for  theoretical  reasons  (Paivio, 
1971)  and  because  it  offers  an  effective  means  of  memorizing  certain 
kinds  of  information  (Bower,  1972;  BugelskI,  I968).  Raugh  and  Atkinson 
(197L)  developed  an  application  of  mental  imagery  to  the  acquisition  of 
a  second- language  vocabulary  and  reported  a  series  01  experiments  in 
which  their  keyword  method  proved  to  be  effective  for  learning  Spanish 
vocabulary  items.  The  purpose  of  tne  work  reported  here  was  to  test  the 
effectiveness  of  the  keyword  method  on  a  non-Romance  language,  namely 
Russian. 

The  keyword  method  divides  the  ^tudy  of  a  vocabulary  item  into  two 
stages.  The  first  stage  requires  S  to  associate  the  spoken  foreign  word 
to  an  English  word  (the  keyword)  that  sounds  approximately  like  some 
part  of  the  foreign  word.  The  second  stage  requires  3  to  form  a  mental 
image  of  the  keyword  "interacting"  with  the  English  translation.  Thus, 
the  keyword  method  can  be  described  as  a  chein  of  two  links  connecting 
a  foreign  word  to  ^te  English  translation:  tne  foreign  word  is  linked 
to  a  keyword  by  a  similarity  m  sound  (acoustic  link),  and  the  keyword 
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is  linked  to  the  English  translation  by  mental  imagery  (mnemonic  or 


imagery  link).  As  an  example,  consider  the  Russian  word  zvorufa, 
meaning  bell.  Its  pronunciation  is  somewhat  like  "zvahn-oak,"  with 
emphasis  on  the  last  syllable,  and  it  contains  a  sound  that  resembles 
the  English  word  "oak.'1  Employing  the  English  wal’d  "oak"  as  the  keyword, 
one  could  imagine  something  like  an  oak  with  little  brass  bells  for 
acorns,  or  an  oak  in  a  belfry,  or  perhaps  an  oak  growing  beneath  a  giant 
bell  jar.  As  another  example,  the  Russian  word  for  ,rbuilding"  (zdtfnie) 
is  pronounced  somewhat  like  "zdawn-yeh’1  with  emphasis  on  the  first 
syllable.  Using  "dawn"  as  the  keyword,  one  could  imagine  the  pink  light 
of  lawn  reflected  in  the  windows  of  a  tall  building. 

The  keyword  method  is  applied  by  presenting  5  with  a  series  of 
spoken  foreign  words.  Each  foreign  word  is  pronounced;  while  the  word 
is  being  pronounced,  a  keyword  and  the  English  translation  are  displayed. 
Do^-lng  the  presentation  of  each  item  S  must  associate  the  sound  of  the 
foreign  word  to  the  given  kevvoru  and  generate  a  mental  image  relating 
the  keyword  to  the  English  translation. 

The  preselection  of  keywords  by  E  is  an  important  aspect  of  the 
metnod.  In  preparing  a  test  vocabulary  a  keyword  is  consiaered  eligible 
if  it  satisfies  the  following  criteria;  (1)  The  keyword  sounds  as  much 
as  possible  like  a  part  (not  necessarily  all)  of  the  foreign  word;  (2) 
it  is  easy  to  form  a  memorable  image  linking  the  keyword  and  the  English 
translation;  and  (3)  the  keyword  is  unique  (different  from  the  other 
ke  rds  used  in  the  test  vocabulary) .  Criterion  1  allows  flexibility 
in  the  choice  of  keywords,  since  any  part  of  a  foreign  word  could  be 
used  as  the  key  sound.  What  this  means  for  a  polysyllabic  foreign  word 
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is  that  anything  from  a  monosyllable  to  a  longer  word  (or  even  a  short 
phrase  that  "spans"  the  whole  foreign  word)  might  be  used  as  a  keyword. 
Criterion  2  must  be  satisfied  to  make  the  imagery  link  as  easy  to  master 
as  possible.  Criterion  3  is  used  to  avoid  the  ambiguities  that  could 
occur  if  a  given  keyword  were  associated  with  more  than  one  foreign  word. 
For  a  large  vocabulary  that  is  divided  into  subvocabularies  to  be  pre¬ 
sented  in  separate  sessions.  Criterion  3  m.ght  be  applied  only  to  each 
subvocabulary. 

In  applying  tne  keyword  method  to  the  acquisition  of  Spanish  vocab¬ 
ulary,  Raugh  and  Atkinson  (197^)  found  large  differences  between  the 
keyword  method  and  various  control  conditions.  Two  of  the  experiments 
used  a  within-subjects  design,  and  the  results  were  especially  impres¬ 
sive  because  Ss  often  used  tne  keyword  method  in  the  control  condition, 
thus  diminishing  the  true  differences.  Moreover,  many  Ss  had  studied 
at  least  one  Romance  language  and  were  able  to  learn  many  words  in  the 
control  condition  by  recognizing  them  as  cognates.  The  results  suggested 
that  it  wouli  be  useful  to  evaluate  the  keyword  method,  using  a  between- 
subjects  design  and  a  foreign  language  that  was  less  obviously  related 
to  languages  previously  studied  by  Ss. 

Russian  was  selected  for  the  work  reported  here.  In  addition  to 
being  a  non-Romance  language  Russian  posed  a  special  challenge  to  the 
keyword  method  because  Russian  involves  a  number  of  frequently  recurring 
phonemes  that  do  not  occur  in  English.  Also,  from  a  practial  viewpoint, 
for  many  students  the  Russian  vocabulary  is  more  difficult  to  learn  than 
is  the  vocabulary  of,  say,  German,  French,  or  Spanish;  it  would  be  useful 
if  the  keyword  method  proved  to  be  an  effective  means  of  teaching  Russian 
vocabulary. 


A  120-word  Russian  test  vocabulary  was  divided  into  three  comparable 
IfO-word  subvocabularies  for  presentation  on  separate  days.  The  Ss  were 
ran  under  computer  control.  The  £3s  received  instructions  from  a  cathode 
ray  display  scope,  listened  to  recorded  foreign  language  words  through 
headphones,  and  typed  responses  into  the  computer  by  means  of  a  console 
keyboard.  The  experiment  began  with  an  introductory  session  (Day  0) 
during  the  first  part  of  which  Ss  were  familiarized  with  the  equipment; 
during  the  second  part  Ss  were  assigned  to  the  keyword  and  control  groups 
and  given  instructions  on  the  appropriate  learning  method.  On  each  of 
the  three  following  days  (Day  1,  Day  2,  and  Day  3)  one  of  the  test  sub- 
vocabularies  was  presented  for  study  and  testing-  On  each  of  these  days 
three  study/test  trials  were  given.  The  study  part  of  a  study/test  trial 
consisted  of  a  run  turough  the  subvocabulary;  each  foreign  word  was  pro¬ 
nounced  end,  depending  upon  t.ie  treatment  group,  either  (i)  the  keyword 
and  English  translation  were  displayed  (keyword  group),  or  (ii)  the 
English  translation  alone  was  displayed  (control  group).  A  test  trial 
consisted  of  a  run  through  the  subvocabulary  in  which  each  foreign  word 
was  pronounced  and  15  sec.  were  allowed  for  S  to  type  the  English  trans¬ 
lation.  A  comprehensive  test  covering  all  120  items  of  the  vocabulary 
was  given  the  day  after  the  presentation  of  the  last  subvocabulary  (Day 
k).  A  similar  test  was  given  approximately  six  weeks  later. 

Method 

Subjects.  Fifty-twc  Stanford  University  undergraduates  were  used 
(26  males  and  26  females).  Each  spoke  English  as  the  native  language, 
none  had  studied  Russian,  and  none  had  participated  in  prior  experiments 
using  the  keyword  method  with  Spanish. 
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Stimulus  material.  A  test  vocabulary  of  120  Russian  nouns  with 
associated  keywords  was  selected  (see  Appendix),  The  test  vocabulary 
represents  a  typical  cross-section  of  vocabulary  items  presented  in  the 
first-year  Russian  curriculum  at  Stanford  University.  English  transla¬ 
tions  of  the  Russian  vocabulary  were  ranked  according  to  imageability  as 
determined  both  by  judgment  of  E  and  the  Paivio  ("Imagery  and  familiarity 
ratings  for  2448  words:  Unpublished  norms ")  image  values  for  those  English 
words  for  which  values  were  available.  The  average  Paivio  value  for  the 
15  most  imageable  words  was  6.J2,  and  the  average  for  the  15  least 
imageable  words  was  2.51.  The  keywords  were  selected  by  a  four-person 
committee  whose  members  were  familiar  with  the  keyword  method.  For  some 
items,  the  committee  chose  keyword  phrases  rather  than  single  keywords; 
a  total  of  38  keyword  phrases  were  used  in  the  test  vocabulary.  The 
test  vocabulary  was  divided  into  three  subvocabularies  of  40  words  each, 
matched  in  abstractness  and  imageability. 

Procedures.  During  the  first  session  (Day  0)  E  showed  each  S  how 
to  start  the  computer  program  that  conducted  the  experiment.  The  program 
itself  explained  all  of  the  remaining  procedures.  After  giving  instruc¬ 
tions  on  the  use  of  the  keyboard  and  audio  headset,  the  program  introduced 
keywords  as  a  means  of  focusing  attention  on  the  sound  of  a  Russian  word. 
In  order  to  provide  all  Ss  with  experience  in  the  procedures,  practice 
was  given  on  a  randomized  list  of  30  words  (not  included  in  the  test 
vocabulary);  a  Russian  word  was  spoken  and  its  keyword  was  displayed  in 
brackets  for  5  sec.  Afterwards,  a  test  (randomized  for  each  S)  was  given 
in  which  each  Russian  word  was  spoken,  and  10  sec.  were  allowed  to  start 
typing  the  keyword.  If  a  response  was  begun  within  10  sec.,  the  time 
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period  was  extended  from  10  to  15  sec.;  otherwise,  the  program  advanced 
to  the  next  item-  A  second  randomized  study  of  the  30  practice  words 
was  given,  followed  by  a  newly  randomized  test.  Throughout  the  experi¬ 
ment,  the  same  training  and  randomized  presentation  procedures  were 
follt-ved. 

After  the  keyword  practice,  Ss  were  randomly  assigned  to  the  experi¬ 
mental  and  control  groups  with  the  contraint  that  both  groups  contain  an 
equal  number  of  males  and  females.  The  Ss  were  given  the  appropriate 
written  instructions  on  the  method  for  associating  Russian  words  to 
English  translations.  The  experimental  instructions  were  like  the  key¬ 
word  instructions  for  Experiment  I.T!  presented  in  Raugh  and  Atkinson 
(197U).  They  explained  that  while  a  Russian  word  was  being  pronounced, 
a  keyword  (or  keyword  phrase)  would  be  displayed  in  brackets  at  the  left- 
hand  margin  of  the  screen  and  the  English  translation  would  appear  to 
the  right.  Experimental  Ss  were  instructed  to  learn  the  keyword  first 
and  then  picture  an  imaginary  interaction  between  the  keyword  and  the 
English  translation;  the  experimental  instructions  also  stated  that  if 
no  such  image  came  to  mind,  they  could  generate  a  phrase  or  sentence 
incorporating  the  keyword  and  translation  in  some  meaningful  way.  The 
control  instructions  explained  that  while  each  Russian  word  was  pro¬ 
nounced,  the  English  translation  would  be  displayed  near  the  center  of 
the  screen.  Control  £s  were  told  to  learn  in  whatever  manner  they 
wished;  control  Ss  were  noi  given  instructions  on  the  use  of  keywords  or 
mental  imagery. 

fter  the  instructions  were  given,  a  pra  ti -e  series  of  ten  Russian 
words  was  presented  in  which  each  Russian  word  was  spoken  while  the 
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English  transition  was  displayed;  for  Ss  in  the  experimental  group  the 
appropriate  keyword  was  also  displayed  with  each  English  translation. 
Following  this  a  test  trial  was  given  in  which  each  Russian  word  was 
spoken  and  S  attempted  to  type  the  English  translation.  A  second  study 
trial  was  given  and  was  followed  by  a  second  test  trial,  concluding  Day 
0.  The  Ss  were  told  that  practice  on  the  10-word  list  was  like  the  pro¬ 
cedure  for  the  remainder  of  the  experiment. 

The  Ss  returned  the  following  day  for  the  Day  1  session.  For  each 
S  the  computer  program  randomly  selected  one  of  the  three  40-word  sut- 
vocabularies  for  presentation.  Lay  1  consisted  of  three  successive 
study- test  trials.  The  study  trial  was  exactly  like  the  study  trial  at 
the  end  of  Day  0:  each  Russian  word  was  spoken  while,  depending  upon  the 
group,  either  the  key  ord  and  English  translation,  or  the  English  trans¬ 
lation  alone,  were  displayed.  For  both  groups,  the  presentation  was 
timed  for  10  sec.  per  item.  The  test  trials  were  identical  for  both 
groups :  each  Russian  word  was  spoken  and  S  had  10  sec.  to  initiate  a 
response.  No  feedback  was  given;  an  incomplete  or  misspelled  response 
was  scored  as  incorrect. 

Day  1,  Day  2,  and  Cay  3  (which  fell  on  consecutive  days)  followed 
identical  formats.  The  only  different  was  that  each  day  involved  a 
different  randomly  assigned  subvccabulary. 

The  Comprehensive  Tesc  followed  on  Day  4.  The  Comprehensive  Test 
was  exactly  like  a  daily  test  trial,  except  that  it  covered  the  entire 
120-word  test  vocabulary.  For  the  sixth  and  final  session  (the  Delayed 
Comprehensive  Test),  Ss  were  called  back  about  30  to  60  days  (average 
43  days)  from  Day  0  to  take  a  randomized  repeat  of  the  Comprehensive 
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Test.  The  Ss  had  not  been  forewarned  that  they  would  be  tested  at  a 
later  date. 

Be suits 

The  Day  0  keyword-practice  phase  of  the  experiment  was  identical 
for  both  the  experimental  and  control  groups.  The  results  of  the  key- 
v  rd  tests  averaged  over  trials  were  51#  for  male  keyword  Ss  and  53# 
for  male  control  Ss;  the  comparable  scores  for  females  were  59#  ^  58#  > 
respectively.  The  average  overall  score  for  keyword  Ss  was  55#  and  the 
corresponding  average  for  control  Ss  was  56#*  The  results  indicate  that 
the  keyword  and  control  groups  were  evenly  matched  so  far  as  per"ormance 
on  the  pretest  was  concerned. 

Table  1  presents  results  of  the  Comprehensive  Test  in  which  the 
probability  of  a  correct  response  is  given  as  a  function  of  sex,  treat¬ 
ment  group,  and  day  on  which  the  word  was  studied;  for  example,  the 
table  shows  that  on  the  Comprehensive  Test  females  in  the  keyword  group 
responded  correctly  to  76#  of  the  words  that  they  had  studied  on  Day  2, 
whereas  males  responded  correctly  to  63#  of  the  words  studied  on  Day  2. 

A  str  by  treatment  analysis  of  the  Comprenenslve  Test  data  was  made 
wherein  performance  on  the  Day  1,  Day  2,  and  Day  3  subvocabularies  were 
viewed  as  repeated  trials.  It  was  found  that  keyword  Ss  were  superior 
to  the  control  Ss,  F(l,48)  =  35*8,  £  <  .001;  moreover,  the  female  Ss 
performed  significantly  better  than  the  male  Ss,  F(l,48)  =  5.9,  £  <  .025. 
Ho  interactions  between  sex  and  treatment  were  found.  Because  Ss 
were  volunteers  we  cannot  say  whether  the  sex  differences  reflect  a 
sampling  error  or  an  actual  difference  betwten  males  and  females.  In 
any  case,  the  results  suggest  that  for  vocabulary- learning  experiments 
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Table  1 


Probability  of  a  Correct  Rueponse  on  the  Comprehensive  Test 
as  a  Function  of  Treatment  Group,  Sex,  and  Study  Day 


Keyword 

Control 

Male 

Female 

Mean 

Male 

Female 

Mean 

Day  3. 

.55 

•73 

.64 

.27 

.40 

.33 

Day  2 

.63 

•76 

.70 

.38 

.47 

.43 

Day  3 

.80 

.82 

.81 

60 

.67 

•63 

Mean 

.66 

.77 

.72 

.42 

•  51 

.46 
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of  this  sort,  care  should  be  taken  to  insure  that  males  and  females  are 
evenly  divided  among  treatment  groups. 

Figure  1  presents  the  probability  of  a  correct  response  on  each  of 
the  three  test  trials  for  Day  1,  Day  2,  and  Day  3*  The  keyword  group 
in  all  cases  obtained  superior  scores;  in  fact,  on  each  day  the  keyword 
group  learned  et  least  as  many  words  in  two  study  trials  as  the  control 
group  learned  in  three  trials. 

An  analysis  of  performance  on  the  test  vocabulary  was  made  with 
respect  to  imageability.  The  vocabulary  had  been  ranked  according  to 
the  image  values  of  the  English  translations,  and  divided  into  four 
levels  of  imageability.  Each  level  contained  an  equal  number  of  words 
from  each  of  the  three  subvocabularies.  The  15  most  highly  imageable 
words  (5  taken  from  each  subvocabulary)  were  assigned  to  Level  1.  The 
next  ranking  45  words  (15  from  each  subvocabulary)  were  assigned  to 
Level  2,  and  the  next  45  words  were  assigned  to  Level  3»  The  15  least 
imageable  words  were  assigned  to  Level  4  Table  2  presents  the  average 
probability  that  a  wort?  of  a  given  level  elicited  a  correct  response  on 
the  Comprehensive  Test  ior  both  tfr-  keyword  and  control  groxips.  No 
significant  difference  was  found  across  levels  for  the  keyword  group, 
whereas  for  the  control  group  F(3>25)  =  3*1,  £  <  *05.  Thus,  image  level 
did  not  affect  performance  in  the  keyword  condition;  on  the  other  hand, 
it  appears  that  high  imageability  facilitated  learning  in  the  control 
condition. 

Figure  2  presents  a  scatter  plot  of  the  120  words  in  the  test  vocab¬ 
ulary;  each  point  represents  performance  for  a  particular  word  on  the 
Comprehensive  Test.  The  abscissa  gives  the  probability  of  a  correct 
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Probability  Correct  in  Control  Condition 

Scatter  plot  of  performance  levels  on  the  Comprehensive 
Test.  Each  point  corresponds  to  an  item;  the  ordinate 
gives  the  performance  level  when  the  item  was  studied 
in  the  keyword  condition,  and  the  abscissa  its  value 
when  studied  in  the  control  condition. 


response  in  the  control  group  and  the  ordinate  gives  the  same  probability 
in  the  keyvord  group.  For  example,  the  word  at  (.35>»8l)  is  galstuk 
(where  tne  keyvord  is  "gallstone"  and  the  English  translation  is 
"necktie") ;  its  probability  of  being  correct  on  the  Comprehensive  Test 
was  .35  for  control  Ss,  and  .81  for  keyword  S3.  Points  above  the  diagonal 
in  Figure  2  refer  to  words  that  were  learned  more  effectively  in  the  key¬ 
word  condition,  whereas  points  below  are  for  words  that  were  learned  more 
effectively  in  che  control  condition.  The  word  at  (.19,«8l),  dvor 
(keyword:  divorce;  translation:  yard),  did  especially  well  in  the  keyword 
condition  relative  to  its  performance  in  the  control  condition,  whereas 
the  word  at  (.58, .27),  l£pa  (keyword:  laughter;  translation:  paw)  did 
especially  poorly.  A  reason  for  the  poor  performance  could  be  that 
either  the  keyword  link  was  difficult  to  learn  or  the  imagery  link  was 
difficult  to  form,  resulting  in  an  ineffective  memory  chain  between  the 
Russian  word  and  the  English  translation.  We  will  return  to  this  point 
later. 

Tne  results  of  the  Delayed  Comprehensive  Test  are  displayed  in 
Table  3.  The  keyword  group  outperformed  the  control  group  in  all  male- 
male  and  female-female  comparisons.  Note  tnat  keyword  Ss  recalled  more 
words  from  the  Day  1  study  list  than  from  the  Day  3  list,  whereas  the 
opposite  relation  held  on  the  Comprehensive  Test  (  *e  Table  1).  Thus, 
a  recency  effect  over  dayp  "as  exhibited  on  the  first  Comprehensive  Test, 
whereas  a  primacy  effect  over  days  prevails  on  the  delayed  test.  This 
result  is  somewhat  surprising,  although  Schnorr  and  Atkinson  (1970) 
obtained  a  similar  finding  in  an  experiment  in  which  Ss  used  a  mental 
imagery  strategy  to  learn  English  paired-associates;  recency  was  observed 
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Table  3 

Probability  of  a  Correct  keeper) ee  on  the  Delayed  Comprehensive 
Iftat  as  a  Function  of  Treatment  Group,  Sex,  and  Study  Day 


Control 

Male 

Mean 

FeeMle 

Mean 

Day  1 

.38 

.58 

.48 

.15 

•  34 

.25 

Day  2 

•36 

.51 

.44 

.19 

.40 

.30 

Day  3 

•  30 

.41 

.36 

.21 

.36 

.29 

Mean 

.35 

.50 

A3 

*18 

.37 

.*>6 

Mean 


on  an  immediate  recall  test,  whereas  primacy  was  observed  on  a  delayed 
test  one  week  later.  Table  3  indicates  no  serial  position  effect  for 
the  control  group. 

A  question  of  seme  inteiest  is  whether  keyword  phrases  facilitate 
learning  as  much  as  single  keywords  do.  Our  data  cannot  answer  the  ques¬ 
tion  because  we  did  not  systematically  vary  the  number  of  keywords  used 
for  each  Russian  item.  Ne /ercheless,  the  data  are  suggestive.  In  the 
experimental  condition  38  items  involved  the  use  of  keyword  phrases 
instead  of  a  single  keyword.  For  example,  the  keyword  phrase  "narrow 
road"  was  associated  with  the  word  nardd,  and  "tell  pa"  was  associated 
with  tolpgf.  The  average  performance  of  the  keyword-phrase  items  on  the 
Comprehensive  Test  was  .’Jh  in  the  keyword  condition  and  .44  in  the  con¬ 
trol  condition.  The  corresponding  averages  for  single -keyword  items 
were  .71  and  .45,  respectively.  Thus,  the  probability  of  learning  a 
keyword-phraso  item  was  about  the  same  as  the  probability  of  learning  a 
single -keyword  item. 

Discussion 

Results  using  the  keyword  method  raise  a  number  cf  issues;  some  of 
these  issues  have  been  discussed  elsewhere  (Raugh  &  Atkinson,  1974)  an8 
will  not  be  reviewed  in  this  paper.  Of  special  interest  to  the  experi¬ 
ment  reported  here  is  the  question:  Should  the  experimenter  supply  the 
keyword,  as  we  have  dene,  or  can  the  subject  generate  his  own  more 
effectively?  The  answer  to  this  question  is  somewhat  complicated.  In 
an  unpublished  experiment  similar  to  the  one  described  here,  all  subjects 
were  gi  w n  instruction  in  the  keyword  method.  During  the  actual  experi¬ 
ment  half  of  the  items  were  presented  for  study  with  a  keyword,  whereas 


no  keyword  was  provided  for  the  other  items.  The  subjects  were  instructed 
to  use  the  keyword  method  throughout.  When  a  ^ eyvord  was  provided  they 
were  to  use  that  word;  when  no  keyworc.  was  provided  they  were  to  generate 
their  o»/n.  Or  the  Comprehensive  Test  the  subjects  were  better  on  the 
keyword-supplied  items  than  on  the  others,  but  the  size  of  the  difference 
was  small  in  comparison  to  the  difference  between  groups  reported  in  this 
paper.  Instruction  in  the  keyword  method  was  helpful,  and  somewhat  more 
so  if  the  experimenter  also  supplied  the  keywords. 

It  should  be  kept  in  mind  that  our  results  are  for  subjects  who  have 
not  had  previous  training;  in  Russian.  It  mcy  well  be  that  supplying  the 
keywords  is  most  helpful  to  the  beginner,  and  becomes  less  useful  os  the 
subject  gains  familiarity  with  the  language  and  the  method.  We  have  run 
an  experiment  using  a  Spanish  vocabulary  whew  -ubjects  were  instructed 
in  the  keyword  method,  but  during  study  of  an  item  received  a  keyword 
only  if  they  requested  it  by  pressing  an  appropriate  key  on  their  com¬ 
puter  console  (Raugh  &  Atkinson,  1974).  We  call  this  variant  of  the 
keyword  method  the  free-choice  procedure.  When  an  item  was  initially 
presented  for  study  a  keyword  was  requested  89$  of  the  time;  on  sub¬ 
sequent  presentations  of  the  item  the  subject's  likelihood  of  requesting 
the  keyword  depended  upon  whether  or  not  he  missed  the  item  on  the 
preceding  test  trial.  If  he  missed  it,  his  likelihood  of  requesting 
the  keyword  was  much  higher  than  if  he  had  been  able  to  supply  the 
correct  translation.  Otherwise,  however,  the  likelihood  of  requesting 
a  keyword  was  remarkably  constant  from  one  day  of  the  experiment  to  the 
next;  that  is,  there  was  no  decrease  in  keyword  requests  over  the  three 
study  days,  where  on  each  day  the  subject  learned  a  new  vocabulary.  It 
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iz  interesting  to  note  that  performance  on  the  Comprehensive  Test  for 
the  free-choice  group  was  virtually  identical  to  the  performance  of  a 
group  tnat  was  automatically  given  a  keyword  on  all  trials.  Not  much 
of  a  difference  would  be  expected  between  the  two  groups  since  the  free- 
choice  subjects  had  such  a  high  likelihood  of  requesting  keywords. 
Nevertheless,  these  findings  suggest  that  the  free-choice  mode  may  be 
the  preferred  one.  In  the  free-choice  procedure  subjects  report  that 
they  generally  wanted  a  keyword,  but  that  there  were  occasional  items 
that  seemed  to  stand  out  and  could  be  mastered  immediately  without  the 
aid  of  a  keyword.  In  summary,  the  answer  to  our  question  is  that  sub¬ 
jects  appear  to  be  somewhat  less  effective  when  they  must  generate  their 
own  keywords  j  but  results  from  the  free-chc'.ce  procedure  indicate  that 
keywords  need  only  be  supplied  when  requested  by  the  subject. 

Let  us  now  turn  to  a  somewhat  different  issue.  As  Figure  2  indicates, 
some  items  are  learned  more  readily  than  others.  Poor  performance  on  a 
given  item  in  the  keyword  condition  could  be  because  the  acoustic  link, 
the  imagery  link,  or  both  were  difficult  to  master,  thereby  yielding  an 
ineffective  memory  chain  between  the  Russian  word  and  its  English  trans¬ 
lation.  A  test  of  this  hypothesis  involves  having  one  group  of  subjects 
lear  'i  only  the  foreign  word  to  keyword  link  and  another  independent  group 
learn  only  the  keyword  to  translation  link.  We  have  conducted  such  an 
experiment  with  the  120-word  Russian  vocabulary  used  in  the  study  re¬ 
ported  here.  For  each  item  an  estimate  was  obtained  for  the  probability 
of  a  correct  response  averaged  over  the  first  two  test  trials.  We  will 
denote  that  probability  as  A  for  the  group  learning  the  acoustic  link, 
and  as  I  for  the  group  learning  the  imagery  link.  Finally,  let  K  be  the 
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probability  of  a  correct  response  averaged  over  the  first  two  test  trials 
for  an  item  in  the  keyword  group  in  our  original  experiment.  It  is  the 
case  that  the  product  of  A  XI  (that  is,  the  probability  of  knowing  the 
acoustic  link  times  the  probability  of  knowing  the  imagery  link)  is  a 
fairly  good  predictor  of  perfomance  in  the  keyword  condition.  Table  4 
displays  the  correlation  matrix  using  rank-order  data.  Note  that  the 
correlation  between  A  and  I  is  i  ir  zero,  indicating  that  the  learning 
of  the  acoustic  link  is  not  related  to  the  learning  of  the  imagery  link. 
Note  also  that  +he  correlation  between  the  product  Axl  and  the  variable 
K  is  .73;  the  product  is  a  fair  predictor  of  performance  in  the 
keyword  condition.  The  C  entry  in  the  tabl  is  comparable  to  the  K 
entry,  except  th-c  it  denotes  performance  for  the  control  group  in  our 
original  experiment.  Note  that  C  is  not  as  good  a  predictor  of  K  as  is 
the  product  A  X  I. 

A  theoretical  framework  for  interpreting  these  results  is  provided 
by  Atkinson  and  Wescourt  (1974).  According  to  their  theory,  early  in 
the  learning  process  the  memory  structure  for  a  given  item  involves  only 
two  independent  links  (what  we  have  called  the  acoustic  and  imagery 
links).  However,  with  continued  practice  a  third  link  is  formed  directly 
associating  tne  foreign  word  wi' h  its  English  translation.  It  is  this 
direct  linx  that  sustains  performance  once  an  item  is  highly  practiced; 
the  subject  may  still  be  able  to  access  the  keyword  but  the  retrieval 
process  based  on  the  direct  association  it  so  rapid  that  the  subject 
only  recalls  the  keyword  under  special  circumstances,  like  when  he  is 
consciously  trying  to  do  so  or  has  a  retrieval  failure  in  the  primary 
process.  But  the  less  direct  chain  of  the  acoustic  and  imagery  links 
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Table  4 

Correlation  Matrix  for  the  Variables  A  X  I,  K,  C,  A,  and  I 

AX  I  K  CAT 


has  the  advantage  that  it  is  easily  learned  and  provides  a  crutch  for 
the  subject  as  he  learns  the  direct  association;  it  facilitates  the 
learning  of  the  direct  association  by  insuring  that  the  subject  is  able 
to  recall  iters  early  in  the  learning  process. 

There  is  some  evidence  to  suggest  that  students  use  mediating 
strategies  similar  to  the  keyword  method  when  learning  a  vocabulary, 
even  if  not  instructed  to  do  so.  Ott,  Butler,  Blake,  and  Ball  (1973), 
in  a  paper  on  the  use  of  mental  imagery  i.  vocabulary  learning,  report 
that  Ss  not  given  special  instructions  when  asked  to  learn  a  foreign 
vocabulary  often  resort  to  using  English  mediating  words  combined  with 
imagery  cr  other  mnemonic  aids.  Their  observation  suggests  that  the 
keyword  method  is  not  essentially  different  from  techniques  commonly 
employed  by  students.  The  major  difference,  apart  from  the  fact  that 
E  supplies  the  keywords,  is  the  extent  to  which  the  method  is  applied. 

Our  experimental  findings  indicate  that  the  keyword  method  should 
be  evaluated  in  an  actual  teaching  situation.  Starting  this  fall,  we 
will  be  running  a  computerized  vocabulary- lemming  program  designed  to 
supplement  a  college  course  in  Russian.  The  program  will  operate  much 
like  our  experiments.  When  a  word  is  presented  for  study  it  will  be 
pronounced  by  the  computer  and  simultaneously  the  English  translation 
will  be  displayed  on  a  CRT.  The  student  will  be  free  to  study  the  item 
anyway  bp  pleases,  but  he  may  request  that  a  keyword  be  displayed  by 
pressing  an  appropriate  button  on  his  console.  Students  will  be  exposed 
to  about  800  words  per  quarter  using  the  computer  program,  which  in 
conjunction  with  their  normal  classroom  work  should  enable  them  to 
develop  a  substantial  vocabulary.  We,  in  turn,  will  be  able  to  answer 
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a  number  of  questions  about  the  keyword  method  when  it  is  used  over  an 
extended  period  of  time.  Many  foreign  language  instructors  believe  that 
the  major  obstacle  to  successful  instruction  is  not  learning  the  grammar 
of  a  language,  but  in  acquiring  a  sufficient  vocabulary  so  that  the 
student  can  engage  in  spontaneous  conversation  and  read  materials  other 
than  the  textbook. 

If  the  instructional  application  proves  successful,  then  the  keyword 
method  and  variants  thereof  deserve  a  role  in  language-learning  curricula. 
The  keyword  method  may  prove  useful  only  ir  che  early  stages  cf  learning 
a  language  and  more  so  for  some  classes  of  words  than  others.  The  method 
may  not  be  appropria*  .or  all  learners,  but  there  is  the  possibility 
that  seme,  especia^y  those  who  have  difficulty  with  foreign  languages, 
will  receive  particular  benefits. 
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APPENDIX 


Russian  Test  Vocabulary,  Related  Keywords,  and  Performance 
Levels  on  the  Comprehensive  Test 


Subvocabulary  1 

Performance 

Level 

Russian 

Keyword 

Translation 

Keyword 

Control 

1.  EEVUSHCA 

[dear  vooshka] 

GIRL 

1.00 

•  50 

2.  JjOSHAD’ 

[sausage] 

HORSE 

.81 

•  58 

3.  LES 

[yes] 

WOODS 

•  58 

.31 

4.  BLOXA 

[block] 

FLEA 

.54 

•  50 

5.  KROVAT' 

[cravat] 

BED 

.85 

•  58 

6.  GALSTUK 

[gallstone] 

NECKTIE 

.31 

.35 

7.  IZB/J 

[he's  bad] 

HUT 

.65 

•58 

8.  KRYSHA 

[Kruschev] 

ROOF 

•69 

•  54 

9.  STOL 

[ stole ] 

table 

.69 

•  5' 

10.  POLE 

[pole] 

FIELD 

•54 

•  50 

11.  MOST 

[most] 

BRIDGE 

•  50 

.46 

12.  POEZD 

[poised] 

TRAIN 

.85 

.46 

13.  VRACH 

[wretch] 

PHYSICIAN 

.58 

•  35 

14.  KARANDASH 

[car  run  dash] 

PENCIL 

.81 

•  38 

15.  TAREIKA 

[daddy  elk] 

PLATE 

•77 

•  31 

16.  HOT 

[rut] 

MOUTH 

.85 

.46 

17.  STAKAN 

[stuck  on] 

GLASS 

.8* 

.62 

18.  LED 

[debt] 

GRANDFATHER 

.35 

.62 

19.  UZHIN 

[engine] 

SUPPER 

.69 

•  35 

20.  OVOSHCHI 

[oven,  beet] 

VEGETABLES 

.81 

.42 
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Performance  Level 


Russian 

Keyvord 

Translation 

Keyword 

Control 

21.  CHELOVSC 

[chilly  back] 

PERSON 

.85 

.46 

22.  RAUOTA 

[rovboat] 

WOHC 

.54 

.65 

23.  LAPA 

[laughter] 

PAW 

.27 

.58 

24.  VOJNA 

[why  not] 

WAR 

•77 

.50 

25.  ZHENA 

[she  gnaw) 

WIFE 

.58 

•50 

26.  ROulNA 

[ regiment ] 

FATHERLAND 

.69 

<38 

27.  DOZHD' 

[douche] 

RAIN 

H 

CO 

• 

.65 

28.  ERUNDA 

[yer  own  doll] 

RUBBISH 

.62 

•  31 

29.  LGUN 

[lagoon] 

LIAR 

•77 

•  58 

30.  DURflC 

[t».c  rocks] 

FOOL 

.88 

.42 

31.  DEN' 

[Jane] 

DAY 

.81 

•77 

32.  GOLOD 

[gullet] 

HUNGER 

.65 

.23 

33.  RECH* 

[reach] 

SPEECH 

.65 

.58 

3 4.  LAVKA 

[Ala'’;a] 

SHOP 

.33 

.40 

35*  VOPROS 

[pros] 

QUESTION 

.62 

.38 

36.  GOD 

[goat] 

YEAR 

.38 

•  38 

3 7.  GLAGOL 

[gargle] 

VERB 

.69 

•  31 

38.  CENA 

[it's  enough] 

PRICE 

.65 

•  35 

39.  USLOVIE 

[Yugoslavia] 

CONDITION 

.92 

.46 

40.  Kusck 

[blue  sock] 

PIECE 

.85 

.27 

Subvocabulary  2 

41.  SLOW 

[so  long] 

ELEPHANT 

.65 

.65 

42.  ISM. 

[he's  shocked] 

D01KEY 

•73 

.46 

43.  ZHABk 

[Jaw  bone] 

TOAD 

.73 

•38 

44.  SOB«A 

[tobacco] 

DOG 

.73 

•73 
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performance  Level 


Russian 

Keyword 

45- 

MJASO 

[yes sub] 

46. 

PLAT'E 

[watch  It] 

47. 

BAGOR 

[bug] 

48. 

POL 

[pull] 

49. 

SELO 

[seal  law] 

50. 

LUG 

[luke] 

51. 

TKJK  A 

[troop  car] 

52. 

SKOT 

[squat] 

53- 

PLOSHCHAD* 

[postage] 

54. 

MEL 

[miaow] 

55- 

NOZH 

[mush] 

56. 

PALEC 

[pies] 

57- 

SYR 

[sear] 

58. 

VNUK 

[fluke] 

59. 

OHED 

[a  b'"] 

60. 

SHKAF 

[scoff] 

61. 

SQl'JA 

[see  me  yell] 

62. 

THUD 

[brute] 

63. 

GOLOVA 

[Gulliver] 

64. 

AD 

[bat] 

65. 

MUZH 

[moose] 

66. 

VDOVA 

[David] 

67. 

KITAJ 

[he  died] 

68. 

OSTROV 

[ostrich] 

Translation 

Keyword 

Control 

MEAT 

•73 

.62 

MESS 

•73 

.38 

ROOK 

.77 

.46 

FLOOR 

.38 

•  54 

VILLAGE 

.88 

.54 

MEADOW 

.81 

.42 

PIPE 

•76 

.42 

CATTLE 

•77 

.42 

SQUARE 

.81 

•  35 

CHALK 

.65 

.42 

KNIFE 

.69 

-50 

FINGER 

•65 

•  35 

CHEESE 

•77 

.58 

grandson 

.38 

•19 

DINNER 

•65 

•  38 

CUPBOARD 

.77 

.42 

FAMILY 

.62 

•77 

LABOR 

•71 

.32 

HEAD 

.88 

•77 

HELL 

•73 

•  50 

HUSBAND 

.58 

.62 

WIDOW 

.65 

.58 

CHINA 

.42 

.35 

ISLAND 

•73 

.46 

2b 


Performance  Level 


Russian 

Keyword 

Translation 

Keyword 

Control 

69.  VYXOD 

[boyhood] 

EXIT 

.77 

•  35 

70.  DYM 

[din] 

SMOKE 

.88 

•73 

71.  XANBOJLY 

[can  equally] 

VACATION 

•85 

•  50 

72.  zhAzhda 

[Judge] 

THIRST 

•77 

•  35 

73.  cx5los 

[goal* less] 

VOICE 

.62 

•  38 

74.  SEVER 

[saviour] 

NORTH 

.88 

.65 

75.  SPOR 

[spore] 

ARGUMENT 

.69 

•  54 

76.  OSEN’ 

[ocean] 

AUTO® 

.88 

.42 

77.  STUL 

[stool] 

CHARITY 

.58 

•38 

73.  PAMJAT' 

[palm  Itch] 

MEMORY 

.61 

•50 

79*  SHUM 

[shoe  'em] 

NOISE 

.65 

.62 

80.  CHAST* 

[trash] 

PART 

•77 

.46 

Subvocabulary  3 

81.  KOROVA 

[rover] 

COW 

.65 

.54 

82.  GORA 

[garage] 

MOUNTAIN 

.85 

•38 

83.  PTICA 

[pizza] 

HERD 

.81 

.62 

84.  RYBA 

[rhubarb] 

FISH 

•73 

.52 

85.  MAL'CHDC 

[ay  cheek] 

BOY 

.81 

.77 

86.  shljApa 

[slap] 

HAT 

•73 

•  35 

87 .  ZUREC 

[Juliet’s] 

PRIEST 

.81 

.42 

88.  POTOLCK 

[better  lock] 

CEILING 

.69 

.42 

89.  SAD 

[sat] 

ORCHARD 

.62 

.46 

90.  GOROD 

[go] 

CITY 

•65 

•  55 

91.  EL* 

[Tale] 

FIR 

.81 

.42 

92.  LUfCOR 

[Lincoln] 

BATTLESHIP 

.85 

•  58 
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Performance  Level 


Russian 

Keyword 

93- 

XLEB 

[hurry  up] 

9**. 

TETRAD* 

[she  tries] 

95. 

LOZHCA 

(Moscow] 

96. 

GLAZ 

[glass] 

97. 

UGOL 

[Hugo] 

96. 

RODITELI 

[Oigi] 

99. 

EDA 

[ya  die] 

100. 

vm IA 

[vomit] 

101. 

tolpA 

[tell  pa] 

102. 

NAR0D 

(narrow  road] 

103. 

LICO 

[it's  soft] 

lOU. 

CHERT 

[short] 

105. 

TJOTJA 

[Churchill] 

106. 

BOG 

[balfc] 

107. 

STRANA 

[strawman] 

108. 

SON 

[sun] 

109. 

VOZ'ID* 

[wash] 

110. 

DVOR 

[divo"ce] 

111. 

PRAZDNDC 

[bras  nicked] 

112. 

DOLG 

[dog] 

113. 

vdZDUX 

[fuzz  duke] 

111*. 

ZAPAD 

[zap  it] 

115. 

d£lo 

[Jello] 

Translation 

Keyword 

Control 

BREAD 

.5U 

•  35 

NOTE  BOCK 

.81 

•51* 

SPOON 

•  58 

•  27 

EYE 

• 

00 

•  92 

CORNER 

.85 

.69 

PARENTS 

.81 

.1*2 

FOOD 

.62 

•  19 

BATH 

.73 

.62 

CROWD 

.85 

•  38 

PEOPLE 

•77 

.27 

FACE 

.65 

.50 

DEVIL 

•77 

•  50 

AUNT 

•85 

.1*6 

GOD 

•85 

.58 

COUNTRY 

•85 

.1*2 

SIEEP 

.69 

.1*6 

LEADER 

.62 

•35 

YARD 

.81 

•  19 

HOLIDAY 

.62 

.31 

DEBT 

.62 

•  31 

AIR 

•77 

•  35 

WEST 

.88 

•65 

AFFAIR 

.88 

•  51* 
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Performance  Level 


Russian 

* 

Keyword 

Translation 

Keyword 

Control 

116.  VTORKXK 

[storm] 

TUESDAY 

.54 

•  31 

11?.  PRAVILO 

[pry  your  love] 

RULE 

•77 

.42 

118.  VNIMANIE 

* 

[pneumonia] 

ATTENTION 

.88 

•35 

119.  nachalo 

[not  shallow] 

ffiGINNING 

.81 

.23 

120.  ITOG 

[he  talk] 

SUM 

•  58 

.23 

29 
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Printed  Russian  words  are  presented  in  a  standard  transliteration  of 
the  Cyrillic  alphabet  into  the  Roman  alphabet;  stress  is  marked. 

^An  inspection  of  frequency  histograms  indicated  unimodal  distributions 
for  both  the  keyword  and  control  groups.  There  was  no  evidence  to 
suggest  that  some  subjects  in  the  keyword  group  performed  unusually 
well,  whereas  the  others  were  comparable  to  control  subjects. 
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